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THE  DEVELOPMENT  OF  A  COMPOSITE  SCORE  FOR  EVALUATING  NAP-OF-THE-EARTH 
NAVIGATION 

-N^Interviews  with  experienced  nap-of-the-earth  (NOE)  instructor  pilots 
(IPs)  indicate  there  are  two  major  observable  factors  to  consider  in 
measuring  the  skill  of  an  NOE  navigator:  navigational  accuracy  and  speed. 
The  first  is  defined  as  the  accuracy  with  which  a  navigator  can  locate 
the  initial  point  of  an  NOE  route,  follow  that  route,  identify  checkpoints 
along  the  way  and  locate  the  landing  zone  or  release  point  at  the  end  of 
the  route.  This  factor  can  easily  be  quantified  by  first  determining 
the  correct  flying  distance  and  then  measuring  each  incremental  distance 
resulting  from  inaccurate  navigation.  The  IPs  suggested  all  kinds  of 
inaccuracies  be  judged  as  equally  important,  provided  they  are  of  the 
same  magnitude.  They  suggested  furthermore  that  the  unit  of  measurement 
be  the  ratio  incremental  distance  to  the  length  of  the  route.  Thus 
scores  on  longer  routes  would  not  be  worse  simply  because  of  the  increased 
opportunities  to  make  errors. 


The  second  major  factor  is  the  average  speed  the  NOE  navigator  is 
able  to  maintain  while  flying  along  an  NOE  route.  The  poorer  navigator 
will  progress  slowly,  searching  the  visual  world  outside  the  helicopter, 
attempting  to  associate  terrain  features  with  features  on  the  map.  The 
helicopter  may  be  required  to  hover  frequently  or  to  backtrack  while  the 
navigator  becomes  oriented  or  corrects  errors.  The  better  the  navigator, 
the  more  rapidly  he  will  progress.  A  superior  NOE  navigator,  who  is  well 
oriented  and  skilled  in  terrain  analysis,  will  have  no  need  to  search  a 
wide  area  of  terrain  for  recognizable  features.  He  will  concentrate  on 
the  terrain  ahead  and  fly  toward  it  directly. 


^It  was  deemed  desirable,  therefore,  to  combine  accuracy  and  speed 
into  a  single  composite  score  so  that  NOE  navigators  can  be  compared 
even  when  they  navigate  with  different  styles  (slow  and  accurate  versus 
fast  with  course  errors)  over  routes  of  different  lengths.  The  score 
thus  obtained  should  be  a  quantifiable,  objective  measure  of  the  navi¬ 
gation  performance  of  an  aviator  navigating  at  terrain  flight  altitudes. 
This  measure  of  terrain  navigation  is  designated  by  the  acronym,  TENAV. 

An  earlier  attempt  by  ARI  (Farrell  &  Fineberg,  1976)  to  develop  an 
objective  measure  accounted  only  for  the  accuracy  factor,  was  insensitive 
to  small  errors  (100m  to  250m)  and  classed  all  errors  between  250m  to 
1000m  together.  Instead,  it  is  the  judgment  of  NOE  IPs  and  other  terrain 
navigation  experts  that  all  errors  of  100m  or  more  should  be  registered 
on  a  continuous  scale  rather  than  merely  being  classified  as  250  to  1000m 
or  1000m  and  greater.  Furthermore,  under  the  1974  system  a  failure  to 
locate  an  initial  point  is  quantitatively  as  serious  as  any  other  course 
error.  The  outcome  of  such  an  error  is  the  same  in  both  cases;  either  the 
navigator  becomes  oriented  and  returns  to  course  and  continues  the  mission, 
or  he  fails  to  complete  the  mission. 


Initially  the  IPs  believed  that  Equation  1  would  combine  both  the 
accuracy  and  the  speed  factors  into  .1  single  score: 

TENAV  Score  *  K  .  11) 

1.  x  S 

E  is  each  navigational  error  expressed  in  meters, 

L  the  length  of  the  NOE  route  m  kilometers,  and 
S  the  average  speed  in  kilometers  per  hour. 

However,  further  exploration  revealed  that  orroi  magnitudes  and  speeds 
are  not  always  linearly  related.  Specifically,  a  course  deviation  of, 
for  example,  bOOm  rs  more  than  twice  as  serious  as  a  deviation  of  100m. 
Similarly,  a  navigator  who  averages  b0  km/hour  on  a  particular  NOE  route 
is  not  considered  twice  as  skilled  as  one  averaging  30  km/hour.  Subject  um 
of  various  examples  of  errors  and  speeds  to  the  IPs'  informal  judgment 
on  how  well  they  reflected  navigational  skill  led  to  the  conclusion  that 
the  TENAV  score  should  he  a  power  function  of  both  errors  and  speeds.  The 
following  equation  thus  became  the  working  hypothesis. 


TENAV  Score 


£*»  _ 

1.  X  sY 


(2) 


As  demonstrated  above,  the  exponent  x  would  be  larger  than  1;  whereas  t he 
exjHMient  y  would  bo  less  than  1.  In  order  to  determine  the  values  ot 
those  exponents,  the  following  magnitude  estimation  experiment  was 
conducted . 


METHOD 


SUBJECTS 

Twelve  IPs,  currently  engaged  in  teaching  NOE  flight,  navigation 
and  tactics  at  the  U.S.  Army  Aviation  Center  (USAAVNC) ,  were  subjects 
for  this  experiement. 


TASKS  AND  PROCEDURE 

There  were  two  magnitude  estimation  tasks.  One  dealt  with  the 
seriousness  of  various  magnitudes  of  navigational  error  and  the  other 
with  the  relative  value  of  various  speeds  in  NOE  navigat ion. 
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Navigation  trrori.  Thia  task  required  tha  subjects  to  estimate  tha 
seriousness  of  a  qivan  navigational  error  of  on«  magnitude  whan  compared 
with  an  arror  of  a  diffarant  magnitude.  For  example,  "An  arror  of  500m 

ia  _  times  aa  bad  aa  a  200m  arror.*  After  a  brlaf  introduction,  tha 

subjects  wara  praaantad  22  auch  statements,  ona  at  a  time,  in  random 
ordar.  Tha  atandarda  ranqad  froai  lOOai  to  600m,  tha  comparisons  from  200m 
to  1200m.  Tha  subjects  wara  required  to  fill  in  each  blank  comparing  tha 
two  diatancaa  with  quant i tat iva  maaauraa  of  aariouanaaa. 

Speed.  Thla  taak  raquirad  tha  subjects  to  project  tha  numbar  of 
error s  to  ba  expected  at  ona  apaad  qivan  a  apacifiad  numbe.  of  error* 
at  another.  For  example,  "if  you  make  3  arrora  at  10  knota,  you  would 
make  _  arrora  at  30  knota."  Twanty  of  thaaa  atatamanta,  with  stan¬ 

dards  ranqing  from  10  to  60  knota  and  compariaona  from  20  to  100  knota 
wara  praaantad  in  axactly  tha  aane  taannar  aa  thoaa  daacribad  «bov*. 


DATA  ABDUCTION 

Tha  arror  maqnituda  data  waa  convartad  to  a  common  acala  by  aaaigning 
a  value  of  10  to  a  100m  arror.  Bach  subject's  aatimate,  uainq  100m  an  tha 
standard,  than  datarminad  tha  value  of  a  200m  arror.  Given  thaaa  values, 
further  estimates  using  100m  and  200m  aa  atandarda  determined  tha  value 
of  a  100m  error.  Thia  process  continued  until  values  were  assigned  to 
all  errors  by  each  subject. 

The  spead  value  data  were  converted  to  a  common  scale  by  assigning 
a  value  of  1  to  a  speed  of  10  knots.  Bach  subject's  estimates  were 
handled  as  with  errors  above  until  all  speeds  were  assigned  estimated 
values . 

The  mean  estimated  values  for  each  error  magnitude  and  speed  were 
calculated  and  plotted  on  log-log  graph  paper  (Figure  1). 


RESULTS. 

Tha  plots  of  errors  and  speeds  against  their  respective  estimates 
of  importance  are  linear  on  log-log  paper  (Figure  1).  The  slopes  of 
these  plots  are  the  unknown  exponents  in  Aquation  2.  The  exponent  for  B, 
error  magnitude,  is  1.3.  The  exponent  for  S,  speed,  is  0.0.  Thus, 
equation  2  becomes i 
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CONCLUSIONS 


The  linearity  of  the  log-log  plots  in  figure  l  confitms  the  validity 
of  the  power  functions  in  Equal  ion  2.  The  values  found  fot  the  ex),onents 
conform  to  the  hypotheses  derived  from  informal  interviews.  TKNAV  scores 
can  be  considered  criterion  measures  of  NOE  navigation  performance. 

However,  one  further  adjustment  has  been  made.  Because  equat  ion 
was  derived  in  a  manner  that  did  not  reflect  errors  of  less  than  100m, 
many  pilots,  even  students,  were  achieving  perfect  error  magnitude 
scores  of  zero  (see  Holman,  1977).  Obviously,  equation  2  .is  written 
was  incapable  of  reflecting  the  speed  at  which  this  perfect  error  score 
had  been  achieved.  To  correct  this  deficiency,  equat  ion  was  amended 
to  include  an  assumption  that  every  pilot  makes  a  nominal  error  of  l 00m. 
The  result  is  equation  3: 

TKNAV  Score  -  £e1-  *  ♦  1001-  3  (  3) 

L  x  S« 

Using  this  equation,  a  superior  navigation  score  is  1.0  or  less.  For 
example,  a  15  Vm  route  navigated  at  bO  km/hour  with  no  errors  gets  a 
score  of  1.0.  A  200m  error  added  to  this  example  results  in  a  score  of 
3.5.  Slowing  the  above  speed  to  AO  km/hour  further  increases  the  score 
to  4.8.  A  poor  performance  such  as  lb  km  route  navigated  at  30  km/hour 
with  errors  of  200m,  300m  and  500m  results  in  a  score  of  27.5. 
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